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Abstract 

We perform a comprehensive numerical study of d-wave Fermi surface deformations (cZFSD) on a 
square lattice, the so-called d-wave Pomeranchuk instability including bilayer coupling. Since the 
order parameter corresponding to the dFSD has Ising symmetry, there are two stacking patterns 
between the layeres, (+,+) and (+,—). This additional degree of freedom gives rise to a rich 
variety of phase diagrams. The phase diagrams are classified by means of the energy scale A z , 
which is defined as the bilayer splitting at the saddle points of the in-plane band dispersion. As 
long as A z ^ 0, a major stacking pattern is usually (+,—), and (+,+) stacking is stabilized as a 
dominant pattern only when the temperature scale of the (iFSD instability becomes much smaller 
than A z . For A z = 0, the phase diagram depends on the precise form of the bilayer dispersion. We 
also analyze the effect of a magnetic field on the bilayer model in connection with a possible dFSD 
instability in the bilyared ruthenate SraRr^Oy. 

PACS numbers: 71.18.+y, 71. 10. Ay, 74.70.Pq, 74.72.-h 
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I. INTRODUCTION 



While a wide variety of shapes of the Fermi surface are realized in metals, the Fermi sur- 
face usually respects the point-group symmetry of the underlying lattice structure. However, 
it was found that Fermi surface symmetry can be broken spontaneously due to electron- 
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electron correlations in the two-dimensional i-</,[l|, |2J Hubbard, |3j and extended Hubbard 4] 
models. This instability is driven by forward scattering processes of quasi-particles. Stan- 
dard model interaction leading to such symmetry breaking is given by 

J^/kk'^k^k'- (1) 

k,k' 

Here 

iW = -gd k d k > (2) 

is the forward scattering interaction with d-wave symmetry d^ = cosk x — cosk y and the 
coupling constant g > 0; is the electron density operator. The interaction ([1]) gives rise 
to attraction between quasi-particles around (0, 7r) and those around (0, — tt), and repul- 
sion between (0,7r) and (vr,0). As a result, symmetry of the Fermi surface may be broken 
spontaneously at low temperature as shown by the red lines in Fig. [TJ These d-wave Fermi 
surface deformations (<iFSD) break orientational symmetry of a square lattice and are often 
called a d-wave Pomeranchuk instability or an electronic nematic transition. While these 
three phrases are currently used in the same meaning, it may be worth mentioning the 
conceptional difference. The Pomeranchuk instability indicates breaking of Pomeranchuk's 
stability criterion for isotropic Fermi liquids. 5[] However the <iFSD instability can occur also 
for strongly correlated electron systems such as those described by the t-J model. 
Moreover, the <fFSD instability can be realized without breaking Pomeranchuk's criterion, 
because the transition is typically of first order at low temperature. 0, 9] The concept of 
the electronic nematic state was originally introduced to describe melting of possible charge 
stripes in cuprate superconductors. [h| Hence the electronic nematic state often implies 
underlying charge-stripe order. [ill] However, the c/FSD is driven by forward scattering inter- 
actions, not by the underlying charge stripes which necessarily generate a finite momentum 
transfer. The ciFSD instability provides a different route to the electronic nematic state 
without assuming the underlying charge-stripe order. 

The minimal model describing the <iFSD instability consists of the forward scattering 




FIG. 1: (Color online) d-wave Fermi surface deformations (dFSD). Forward scattering processes of 
quasiparticles around (it,0) and (0, 7r) drive symmetry breaking of the Fermi surface (red lines). 
This symmetry breaking is characterized by the order parameter r/, which is negative and positive 
in (a) and (b), respectively. 



interaction (OQ) and a kinetic term of e 
was extensively investigated in Refs. 



ectrons. This model, which we refer to as the f-model, 



While the interaction considered in Ref. 



is 



expressed in terms of quadrupole density, it becomes the same as our interaction ([T]) after 
a mean-field calculation in Ref. s|. The ciFSD instability occurs around the van Hove filling 
with a dome-shaped transition line in a plane of the chemical potential and temperature. 
The transition is of second order around the center of the dome and changes to a first order 
at the edges of the dome; the end points of the second order line are tricritical points. In the 
weak coupling limit, the phase diagram is characterized by a single energy scale, yielding 
various universal ratios. [9| 

The double-layered strontium ruthenate Sr 3 Ru207 is a material possibly ex 
rfFSD instability, Q which was supported by theoretical studies. 



libitina; the 
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The idea of the ciFSD was also invoked in the context of high-T c cuprates[l, 2, 20] to un- 
derstand the strong xy anisotropy of magnetic excitation spectra in the underdoped and 
optimally doped YBa2Cu30 y with y = 6.6 and 6.85. 2l|, [22| In the more underdoped ma- 
terial YBa 2 Cu 3 6 .45, much stronger anisotropy was observed 23] and two scenarios were 
proposed: (i) a qunatum phase transition to the ciFSD deeply inside the ci-wave super- 
conducting state [24|, |25[ and (ii) strong suppression of singlet pairing, which concomitantly 
enhances the ciFSD order, since the ciFSD is order competing with singlet pairing. [26!] The 
two-dimensional electron gas is also known to show strong anisotropy of resistivity at low 



laiiaii 



temperature in half-filled higher Landau levels. 27 



ways appears along the crystallographic direction. 



>n. 3 



281 ] The orientation of the anisotropy al- 
Theoretically the observed anisotropy 
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(a) ferro-type (F) stacking 





(b) antiferro-type (AF) stacking 
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FIG. 2: Stacking patterns of the rfFSD in a bilayer system and the Fermi surfaces for ej. = — t z : 
(a) ferro-type (F) stacking (rj A r] B > 0) and (b) antiferro-type (AF) stacking {rj A rj B < 0). A large 
t z (= 0.3) is employed so that the bilayer splitting becomes apparent. 

was interpreted as nematic order in continuum models. 0,0,3 

So far, no other materials exhibiting the rfFSD instability are known. However, the rfFSD 
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is a generic tendency in correlated electron systems. It was found not only in the t- J[l|, 12J 
and Hubbard |^, models but also in more general models with central particle-particle 



interactions. [33] The rfFSD can also occur in a three-dimensional system. 34| Therefore the 
rfFSD is an interesting possibility for various materials, except if other instabilities prevail 
over it. 

In layered materials, weak interlayer coupling is present. Since the order parameter of 
the rfFSD is characterized by Ising symmetry (see Fig. [1]), there are two stacking patterns 
(+, +) and (+, — ), as shown in Fig.[2J we call the former ferro-type (F) stacking and the latter 
antiferro-type (AF). In the latter case, macroscopic anisotropy does not appear [Fig. G^b)], 
leading to self-masking of the underlying rfFSD instability. In the framework of the Landau 



expansion of the free energy, it was found that AF stacking is usually favored as 



c axis dispersion at the saddle points of the in-plane band dispersion is finite. 35(. That is, 



ong as the 



the rfFSD turns out to provide spontaneous symmetry breaking which is usually self-masked 
in layered systems. The study Ref. |35| suggests a possibility that the rfFSD is hidden in 
various materials. 

In this paper, we perform a comprehensive numerical study of the rfFSD instability in 
the bilayer f-model. We show that the inclusion of bilayer coupling in the f-model yields 
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a rich variety of phase diagrams upon tuning interaction strength, bilayer dispersions, and 
hopping integrals. The important quantity is the energy scale A z , the bilayer splitting at 
the saddle points of the in-plane band dispersion. For A z ^ 0, a major stacking pattern is 
usually AF, and F stacking is stabilized as a dominant pattern only when the temperature 
scale of the <fFSD becomes much smaller than A z . For A z = 0, the phase diagram depends 
strongly on the form of the bilayer dispersion, leading to a variety of phase diagrams. While 
the saddle points are frequently located at (n, 0) and (0, tt) in a square lattice system, they 
may shift to other k points in the presence of long-range hopping integrals. Even in this 



case, we demonstrate that our conclusion holds. Considering that the <iFSD instabili 



y is 



likely to occur upon applying a magnetic field in the bilayered ruthenate Sr 3 Ru 2 07,[13|, [14] 
we also calculate the phase diagram including the field in the bilayer f-model and choosing 
parameters appropriate to SraR^CV F stacking is stabilized around the van Hove energy 
of the bonding band, but the <iFSD around that of the antibonding band is found to be 
strongly suppressed by the field. 

The paper is structured as follows. In Sec. II we introduce the bilayer f-model. Phase 
diagrams are presented in Sec. Ill for various choices of coupling strength, bilayer dispersions, 
and long-range hopping integrals. We also show a phase diagram in the presence of a 
magnetic field, imitating the experimental situation in S^R^CV The conclusions follow 
in Sec. IV. The present work is complementary to Ref. \3ai and elucidates possible phase 
diagrams of the ciFSD instability in the bilayer model. We hope it will serve as a sound 
foundation to explore the <£FSD instability in bilayered systems. 



II. MODEL AND FORMALISM 



We focus on the minimal bilayer model exhibiting the <iFSD instability and analyze the 
following Hamiltonian, 

H = ( £k ~~ / i ) C kt c L + gjy Yl ^ kk ' ra k<' 

k, cr k, k' 

i=A,B i=A,B 

+£*(£ t <&+&^), o) 

k,cr 

where c^c^) creates (annihilates) an electron with momentum k and spin a in the i = A 
and B planes; n\, = c^c^ is the number operator; iV is the total number of sites on the 
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i plane and fi denotes the chemical potential. We consider hopping amplitudes up to third 
nearest neighbors, i.e., t, t', and t", on the square lattice. The in-plane band dispersion ek 
is thus given by 

e k = — 2t(cos k x + cos k y ) — At 1 cos k x cos k y — 2t"(cos 2k x + cos 2k y ) . (4) 



The forward scattering interaction /^k' drives the c/FSD instability as shown in Fi 



This interaction mimics the effective interaction obtained in the t-J 



and Hubbard 



models. The last term in Hamiltonian ([3]) is the hybridization between A and B planes. We 
consider four types of bilayer dispersions, e k = — ^(cosfc x — cosk y ) 2 , —2t z (cosk x + cosk y ), 
— At z cos y cos and — t z ; The first one is the dispersion suggested for bilayer cuprates 
such as YBa2Cu30 y ; 36j the second is a dispersion taking account of next nearest-neighbor 



hopping between layers; the third is an expected dispersion in a system where adjacent layers 
are shifted by (~, |); the forth is the simplest one. 

Hamiltonian ([3]) is analyzed in the Hartree approximation, which becomes the exact 
analysis of our model in the thermodynamic limit. We obtain the mean field 

k 

which is nonzero only if the electronic state loses fourfold symmetry of the square lattice 
and is thus the order parameter of the (iFSD in the A(B) plane. The FS is elongated along 
the k x and k y directions for r] A( - B ^ > and r] A( - B ^ < 0, respectively, as shown in Fig. (TJ i.e., 
the order parameter has Ising symmetry. F (AF) stacking is thus defined by i] A i] B > 0(< 0) 
(see Fig. [2]) . The mean- field Hamiltonian reads 

tfMP = V(C C) I - z I I T I +ll(v A ) 2 + (v B ) 2 ] (6) 




2g 

where = 6k + rj^^d^ — /i. We determine the mean fields self-consistently under 



the constraint that each plane has the same electron density. A solution with \rj \ ^ 
is in principle allowed and induces spontaneous charge imbalance between the planes. [37] 
However, such a solution costs energy by producing an electric field between the planes. 
The bilayer coupling is generally expected to be weak in layered materials and thus we fix 
t z /t = 0.1. 
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III. RESULTS 



In a square lattice system, the saddle points are located in (ir, 0) and (0, it) for \ f/t\ < 0.5 
and if' = 0. As typical band parameters we choose if ft = 0.35 and t"/t = 0, which were 
employed to discuss Sr 3 Ru 2 07.|l7|, ll8| We define the characteristic scale of e k as the bilayer 
splitting at the saddle points of the in-plane band dispersion, namely 

A z = |e k | at the saddle points of e k . (7) 

This energy scale A z plays a crucial role to understand the property of a phase diagram as 
we will show below. The results for A z ^ are presented in Sec. Ill A and those for A 2 = 
in Sec. Ill B. We deal with the case where the saddle points of e k are shifted from (tt, 0) 
and (0, 7r) in Sec. Ill C. Considering the experimental situation in the bilayer ruthenate, we 
include a magnetic field in Hamiltonian ([31) and clarify the effect of the field in Sec. Ill D. 
We set t — 1 and measure energy in units of t. 



A. Finite A z 

We present results for the bilayer dispersion, e k = — ^f(cosk x — cosk y ) 2 , for which A z = 
t z = 0.1. Figure EJ^a) is the phase diagram for g — 1. The <iFSD instability occurs around 
the van Hove energy of the in-plane band dispersion, namely around /z° H = At' = 1.4 
with a dome-shaped transition line, as in the case of the single-layer model (Ref. [^); T c is 
almost unchanged by the presence of weak interlayer coupling. The phase diagram is almost 
symmetric with respect to // = /i° H and becomes symmetric for t' = t" = because of 
particle-hole symmetry. The transition is of second order at high temperature and changes 
to a first order at low temperature; the end points of the second order line are tricritical 
points. The AF rfFSD is stabilized in most of the region of the phase diagram whereas the 
F <iFSD is realized in very small regions near the tricritical points as shown in the inset. 
Upon decreasing the coupling constant g, the F region tends to be stabilized more near the 
edges of the transition line [Fig. G^b)] and eventually splits from the AF region [Fig. [2(c)] . 
Yet a major stacking pattern is still AF. Below g = 0.5, however, the AF region disappears 
suddenly and no instability occurs around /z° H = 1.4. Instead the <iFSD instability occurs 
around the van Hove energy of the bonding and antibonding bands, i.e. /z v h = 4t' ±t z = 1.3 
and 1.5 [Fig. [3](d)], and the phase diagram contains only the F (iFSD. 
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FIG. 3: (j,-T phase diagrams for the bilayer dispersion 



^(cos k x — cos k y ) 2 for several choices 



of g. Solid lines, T 2nd , denote second order transitions, while first order transitions are denoted 
by open circles, T c lst , and dotted lines, T lst ; the latter, present in panels (a) and (b), corresponds 
to a transition between F and AF; solid circles represent tricritical points. The insets magnify the 
regions around jx ~ 1.065 and T ~ 0.15, and fi ~ 1.62 and T ~ 0.12 in (a), and around jx ~ 1.308 
and T « 0.03 in (b). 

ie phase diagrams in Fig. [3] are strikingly similar to those for e^. = —t z (Fig. 1 in 



T 

Ref. l35l ) regardless of the difference of the bilayer dispersion. In fact, Fig. [3] shows generic 
phase diagrams for a bilayer dispersion which fulfills A z ^ 0. Typically the AF <iFSD state 
is obtained as a major stacking pattern when the instability occurs around the van Hove 
energy of the in-plane band dispersion. When the temperature scale of the <iFSD gets 
smaller upon reducing g, the energy scale of the bilayer dispersion, namely A z , becomes 
relevant. Eventually the instability occurs only around the van Hove energy of the bonding 
and antibonding bands, which is located at /vh = /^h ^ unless the bilayer dispersion 
shifts the saddle points of the in-plane band dispersion; the phase diagram is occupied only 
by F stacking. Therefore as long as A z ^ 0, F stacking is stabilized as a dominant pattern 
only when the temperature scale of the <iFSD becomes much smaller than A 2 , and otherwise 



S 



the major stacking is AF. 



B. A z = 

In the case of A z = 0, we cannot extract a generic conclusion about the phase diagram of 
the g?FSD. The result depends strongly on the form of a bilayer dispersion. We first consider 
the bilayer dispersion e£ = —2t z (cosk x + cosk y ), which is the simplest one fulfilling A z = 0. 
The obtained phase diagrams are shown in Fig. HI In contrast to Fig. [3j we see that the 
instability occurs around = 1.4 even for a small g. This is because the bonding and 
antibonding bands retain the same van Hove energy as that of in-plane band dispersion, 
namely // v h = 1.4, for the present bilayer dispersion. We always obtain the F dFSD as a 
major stacking pattern for both g = 1 [Fig. IH(a)] and 0.5 [Fig. EKb)]. While one would see 
a sizable region of AF stacking for a large g [Fig. IH(a)], this AF region results from the 
presence of a large t'. In fact, AF stacking is strongly suppressed for a smaller t' [Fig. BJc)] 
and completely disappears for t' < 0.27. F stacking then prevails in the whole region of the 
phase diagram even for g = 1. 
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FIG. 4: /i-T phase diagrams for the bilayer dispersion e£ = — 2^(cos k x + cos k y ) for ^ = 1 (a) and 
0.5 (b). The notation is the same as in Fig. 3. In (c), the hopping integral is reduced to t' = 0.28 
and thus the van Hove energy of the in-plane band shifts from /i^ H = 1.4 to /^| H = 1.12. The inset 
magnifies the region near the tricritical point at higher [i in (c). 
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FIG. 5: (a) fi-T phase diagrams for the bilayer dispersion = — At z cos 4f cos for g = 1. The 
notation is the same as in Fig. 3. (b) g dependence of fx c , the critical chemical potential of the 
tiFSD instability, at T = 0.005. The transition is of first order, except for (g, fi) ~ (0.25, 1.401) and 
(0.24, 1.406), where the second order transition occurs. fi lst denotes a first order transition inside 
the symmetry-broken phase. 

The condition A z = also holds for the bilayer dispersion e£ = — 4t z cos 4f cos -y, which is 
expected for a system where lattice sites shift by (~, |) between adjacent layers. Figure E^a) 
shows that the c/FSD instability occurs around /i° H = 1.4, the same as Fig. HI However, the 
stacking pattern is qualitatively different from Fig. HI AF stacking is stabilized for \i < /^° H 
while F stacking for fi > /i° H . This property does not change for a smaller g as shown 
in Fig. Efb). For a much smaller g < 0.25, however, the region of AF stacking shrinks 
to disappear and F stacking always becomes dominant [Fig. [3(b)] . This is because both 
bonding and antibonding bands have the van Hove energy at /i v n = yU° H + t+w ~ 1-4059. 
The shift of the van Hove energy from is very small and thus such an effect starts to 
appear only when the temperature scale of the <iFSD is substantially reduced to become 
comparable to that of |/i v n — A^hI- m this case, as in the case of Fig. [3](d), the c?FSD 
instability occurs around /i v h, leading to F stacking. Since both bonding and antibonding 
bands have the same van Hove energy for the present bilayer dispersion, only one F stacking 
region is obtained in Fig. 0(b). 
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C. Saddle points away from (ir, 0) and (0, 7r) 



When a moderate t" is introduced, the saddle points of the in-plane band dispersion 
shifts to (0,cos _1 a) or (tc, cos _1 /3) with a = —^0- and f3 = — ^ifr if H < 1 or \f3\ < 1. 
In this subsection, we present the results for if = 0.35 and t" = —0.17. The saddle points 
of ek are then in (tt, ±0) and (±0, 7r) with = cos -1 /? ~ 0.357T. As a bilayer dispersion 
we employ eg = — 2t z (cosk x + cosk y ), for which A z now becomes finite, i.e., A z « 0.11. 
Figure [6]( a) is a result for a large g{= 1.2). The presence of the finite A z yields the result 
completely different from Fig. H^a), although the same bilayer dispersion is employed; the 
major stacking pattern now becomes AF. The phase diagram in turn becomes very similar 
to the case of A z ^ 0, i.e., Fig. Eta), regardless of difference of band parameters and a bilayer 
dispersion. This demonstrates the importance to recognize whether the energy scale of A 2 
is finite or vanishes, in order to understand the phase diagram in the bilayer model of the 
dFSD. 

While a major phase is AF for g — 1, the second order transition line extends down to 
T = 0, leading to a quantum phase transition to the (iFSD state. This property does not 
come from the bilayer effect, but from the additional singularity, namely the jump, of the 
density of state at \i = 2.08, due to the local extremes of the in-plane band dispersion at 
(-7T, 0) and (0,7r). This quantum phase transition is realized as long as the ciFSD instability 
occurs near the chemical potential corresponding to the jump of the den sity of states; in the 



present case, we obtain a quantum phase transition for 1.1 > g > 0.65. [38J Except for this, 
the phase diagram has qualitatively same properties as Fig. El^a). 

For smaller g, the temperature scale of the g?FSD becomes small, and the other energy 
scale set by A z should be taken into account. Figure (H^c) is the result for g = 0.5. The c?FSD 
instability occurs around the van Hove energy of the bonding and antibonding bands, i.e., 
yU vH = (2 - (3)(t =F t z ) + 2t'f3 = 1.742 and 1.965, respectively. In this already shown 

in Fig. G](d), the phase diagram is occupied by the F stacking. The <iFSD instability around 
/i v H = 1.742 is strongly suppressed compared to that around /i V H = 1.965. This asymmetry 
comes from strong breaking of particle-hole symmetry due to the presence of sizable if and 
t". 
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FIG. 6: (a) fi-T phase diagrams for the bilayer dispersion ef = —2t z (cosk x + cosk y ) for g = 1.2 

(a) , 1.0 (b), and 0.5 (c). The notation is the same as in Fig. 3; dotted lines (T lst ) are present only 
in (a) and (b). The inset in (a) magnifies the region near the first order transition at higher /i; in 

(b) the inset clarifies the region near the tricritical point around \x = 1.55 and T = 0.156; the inset 
in (c) magnifies the phase at lower \i. 



D. Connection to SraRu^Oy 



The bilayer ruthenate Sr3Ru207 is a material expected to exhibit the rfFSD instability, 13, 



14j] which is also suggested by theoretical studies. 
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171 . 1 181 . Il9j Its experimental phase 



diagram was obtained as a function of a magnetic field. We thus include a magnetic field 

(8) 



k,cr,j 



ii IS] 



in Hamiltonian ([T]). Following the previous theoretical work in the single-layer model 
and LDA calculations 39(] for Sr 3 Ru20y, we choose the band parameters t' = 0.35, t" = 0,[40j 
and ej, = — t z with t z = 0.1; A 2 becomes finite. Since the temperature scale of the rfFSD 
instability in S^R^C^ is about 1 K and is expected much smaller than A z (= 0.1), we 



imitate such a situation choosing a small coupling constant g = 0.5. We set the chemical 
potential to \i — 1.288 so that the <iFSD instability occurs when a magnetic field is applied, 
modeling the experimental situation, [k], [lj| Since the phase diagram is symmetric with 



respect to h — > —h and a 



-a, we focus on the region h > 0. 
12 



FIG. 7: h-T phase diagram designed for S^R^Oy; e£ = —t z , g = 0.5, and /J, = 1.288. 



Figure [7J is the obtained phase diagram, whose property is the same as that obtained 
in the single-layer model. \v\ , The instability occurs around the van Hove energy of the 
bonding band of up-spins, i.e., h = 0.012. As shown in Fig. [3]^d), the phase diagram in 
this case is occupied by the F region. By analogy with Fig. EJ^d), another F (iFSD phase is 
expected around the van Hove energy of the antibonding band of up-spins, which is located 



at h = 0.212. However, as clarified in Ref. Il8|, a magnetic field strongly suppresses the 



onset temperature of the c£FSD. In the present parameters, the maximal T c of the second 
c/FSD phase becomes less than 0.0002, one order magnitude smaller than Fig. [7J Moreover, 
the field range of the second g?FSD phase is less than about 0.0002 around h = 0.212. In 
experiments, therefore, the detection of the predicted second <fFSD phase requires not only 
a measurement at a very low temperature much less than 1 K, but also very precise tuning 
of a magnetic field. 



IV. CONCLUSIONS 



We have performed a comprehensive study of the ciFSD instability in the bilayer model 
considering various bilayer dispersions and tuning coupling strength and long-range hopping 
integrals. The important quantity is A z , i.e., the energy of the bilayer splitting at the saddle 
points of the in-plane band dispersion. As along as A z ^ 0, a major stacking pattern is 
usually AF, and F stacking is stabilized as a dominant pattern only when the temperature 
scale of the <iFSD becomes much smaller than A z . For A z = 0, the phase diagram depends 
strongly on the choice of the bilayer dispersion, leading to a variety of phase diagrams. 
These conclusion holds even when the saddle points of the in-plane band dispersion shift 
from (vr, 0) and (0,7r). In connection with Sr 3 Ru207, the effect of a magnetic field on the 



13 



bilayer model is studied. Since in Sr 3 Ru207, we expect A z ^ and the temperature scale 
of the (iFSD is likely much smaller than A z , we predict the F c/FSD instability around the 
van Hove energy of, in principle, both bonding and antibonding bands. However, the (iFSD 
phase around the antibonding band turns out to be strongly suppressed by a magnetic field. 



In Sr 3 Ru 2 7 , there are three different orbitals, d xy , d yz , and d xz in Ru sites, al 



16 



17 



18 



which 
\m as 



form the bands crossing the Fermi energy. Previous theoretical studies 15 
well as the present work are based on the assumption that d xy orbitals form an active band 
of the <iFSD instability. Recently Raghu et a/.,[4l| and Lee and Wu 42| proposed a different 
scenario that d yz and d xz orbitals are responsible for the <iFSD instability. Considering 
a rich variety of phase diagrams obtained in the present bilayer model, it may be worth 
investigating a role of weak bilayer coupling in their scenario. 

Implications of the present results for cuprate superconductors may be obtained from 
the analysis of the t-J model. The t-J model contains the effective interaction described 

n 

by Eqs.(l) and (2) with a coupling constant g = 3 J/8. [2] While g seems small, the highest 
critical temperature of the (iFSD instability reaches around ~ 0.2J close to half filling 
in the so-called uniform resonating-valence-bond state assumed down to zero temperature 

n 

(see Sec. 3.1 and 3.3 in Ref. [2|). This is because the nearest-neighbor hopping integral is 
strongly renormalized to become smaller than J at low doping. Hence the t-J model may 
correspond to the case of a relatively large g(~ 1) in the present work, implying a large 
effective interaction of the <iFSD for cuprates. 

Application of the present results to cuprate superconductors, however, is not straightfor- 
SD is order competing with superconductivity as found in the t- 



ward, because the d. 
and Hubbard (3, 



43 



44 



45 



traightfor- 



46j models. In fact, the (iFSD instability can be prevailed over by 
superconductivity. Nevertheless sizable correlations of the (iFSD may survive. 4?J The (iFSD 
is still an important tendency, leading to a giant response to a small external anisotropy. 
This idea was invoked to understand the shape of the Fermi surface and magnetic excitations 



in La-based cuprates 



48] as well as the strong anisotropy of magnetic excitations observed 



in YBa2Cu30 r 20|, |26j Furthermore, sizable <iFSD fluctuations substantially reduce the life- 
time of quasiparticles in the antinodal region of the Fermi surface while not in the nodal 
direction. 49[ In this sense, the <iFSD fluctuations contribute to pseudogap behavior, which 



may be relevant to the strongly underdoped YBa 2 Cu 3 0j / .[2i 

The competition of the <iFSD and superconductivity was studied in a general setting 



14 



tuning coupling strength of superconductivity and turned out to lead to a variety of qualita- 
tively distinct phase diagrams. (5 (| Such a study may be extended to the bliayer case. Three 
energy scales of A z , coupling strength of superconductivity, and that of the <fFSD may play 
an important role to elucidate the phase diagram. It is also interesting to see whether the 
competition with superconductivity favors F or AF stacking of the c/FSD. 

Allowing a small momentum transfer in the forward scattering interaction (frj, one can 



incorporate fluctuations of the (iFSD. 



49] Fluctuations of the ciFSD were studied in the con- 



text of quantum criticality,|49|, |5l| the competition with superconductivity, |47| and quantum 



24, 



251 ] The present work 



phase transition deeply inside the <i-wave superconducting state, 
provides a sound basis to extend such studies to a bilayer case, which is more realistic for 
various materials. 
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